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Abstract — Recently, Roth and Skachek proposed two methods 
for constructing nearly maximum-distance separable (MDS) 
expander codes. We show that through the simple modification 
of using mixed-alphabet codes derived from MDS codes as 
constituent codes in their code designs, one can obtain nearly 
MDS codes of significantly smaller alphabet size, albeit at the 
expense of a (very slight) reduction in code rate. 

Index Terms — Expander codes, linear-time encodable and 
decodable codes, maximum-distance-separable codes, mixed- 
alphabet codes 



I. Introduction 

In [2], Guruswami and Indyk presented a method for 
constructing linear-time encodable and decodable nearly 
maximum-distance separable (MDS) expander codes. More 
specifically, their codes have rate at least R and relative 
minimum distance greater than 1 — R — e over an alphabet of 
size 2 c, « 1 °s 1 A)/(fe 4 )) where e > is sufficiently small and 
< R < 1. Subsequently, [3] followed with two constructions, 
one yielding linear-time decodable codes, the other, linear-time 
encodable and decodable codes, that improved upon this result 
by reducing the alphabet size to only 2° ((1 ~ c)(log VOA 3 ) an d 
20(aji(iog i/e)/e ^ respectively, where cur is dependent on R 
but may nevertheless be upper bounded by a universal constant 
independent of R. 

This correspondence furthers the pursuit of reducing the 
alphabet size of nearly MDS expander codes. We will show 
that by using mixed-alphabet codes derived from single- 
alphabet MDS codes as constituent codes in the constructions 
by Roth and Skachek, one obtains (i) linear-time decodable 
nearly MDS codes of rate at least R — e where R > e + 1/2 
and with an alphabet size reduced by a factor of about 1 — e 
in the exponent, and (ii) linear-time encodable and decodable 
nearly MDS codes of rate at least R — e where R = 1 — 0(e) 
and with an alphabet size reduced by a factor of about 1 — 0(e) 
in the exponent. We point out that in both cases, the reduction 
in alphabet size does not come for free and is, in fact, at the 
expense of a reduction in rate. Nevertheless, we will show that 
a significant improvement in alphabet size may be achieved at 
a price of a very small reduction in rate. 

II. Linear-Time Decodable Codes 

A. Preliminaries 

Let G = (V':V",E) be a (finite) A-regular, bipartite, 
undirected, connected graph with edge set E and vertex set 
V = V U V" such that \V'\ = \V"\ = n and V n V" = {}. 
Each edge in E has one endpoint in V' and one in V" so that 
\E\ = nA. Denote by E(v), the set of A edges incident on 



vertex v, and assume an ordering on V which in turn induces 
an ordering on the edges in E{v) for each vertex ucK We 
associate with each edge e G E, an element of GF(2), denoted 
y e . In this way, E may be associated with a binary vector of 
length nA given by y = (y e ) e( z E whose entries are indexed 
by E. 

Let (y) E (u) = (ye)eeE(u) and denote by w((y) E{u) ) its 
Hamming weight. The elements of GF(2) can easily be 
assigned to the edges of G such that 



(1) 



for each u € V and some fixed p G [0, 1). Trivially, there are 
many assignment schemes fulfilling this criteria. However, for 
a given p satisfying 1 > p > p, it is not immediately clear 
whether any of these schemes also satisfy 



(2) 



for each v G V". By leveraging on the fact that G is finite, we 
shall nevertheless prove below that there exist good assignment 
schemes, i.e., schemes satisfying both (Q~|i and (|2). 

Theorem 1: For any p and p satisfying < p < p < 1, 
there exist good assignment schemes. 

Proof: We will show that any assignment scheme which 
randomly assigns pA l's to (y) E t u \ for each u G V, can be 
adjusted to yield a good assignment scheme by swapping some 
l's and O's in (y) E (u) f° r some u £ V . We begin by defining 
the following three types of vertices in V" . Given a vertex 
v G V", we say that v is overweight if w((y) E ( v ' ) ) > pA, 
underweight if w((y) E ( v < ) ) < pA, and balanced otherwise. If 
there are no overweight vertices, we are done. We therefore 
focus on the case where there is at least one overweight vertex. 
Observe that since £ Y^vev" w ((y)E(v)) = pA and p > p, 
an overweight vertex implies the existance of at least one 
underweight vertex. 

Thejpaph G may be converted to a directed graph G = 
(V' : V", as follows. Let u G V and v G V" be two 
endpoints for an edge e G E. If the bit associated with e is 1, 
then the directed edge between u and v is (v,u), otherwise, it 
is (u, v). In either case, the directed edge is associated with the 
same bit as e. In this way, we have a bijective relation between 
the vertices if (resp., edges if) of G and the corresponding 
vertices v (resp., edges e) of G. Moreover, if u G V, all 
the out-edges (resp., in-edges) of it G V are associated with 
symbol (resp., symbol 1) of GF(2). On the other hand, if v G 
V", all the out-edges (resp., in-edges) of if are associated with 
symbol 1 (resp., symbol 0). Further, if v G V" is overweight 
or underweight or balanced, we say that the corresponding 
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Fig. 1. Weight-reduction of (y)e(v 1 ) owing to overweight vertex vi 6 V" . 
(Here, i>i is initially 6-overweight by which we mean that ^((jOe^)) = 
pA + b.) 



vertex if in G is overweight or underweight or balanced, 
respectively. 

We next describe a method for reducing the Hamming 
weight (y)E(v) of an overweight vertex v G V" by 1. Let 
U\,U2 £ V and t>i,t>2,f3 S V" as shown in Fig. Q~fa). Now 
suppose there is an overweight vertex vt 6 V" and a directed 
path from this vertex to an underweight vertex 6 V 
(so that w((y)_B(„ 3 )) < pA), as depicted in Fig. [TJ C )- Let 
t«((y)B( vl )) = pA + 6 for some 6 e [1, (1 - p)A]. We then 
"reverse" all the edges along this directed path as shown in Fig. 
Q2d) where by reversing an edge, we mean flipping both the 
direction of a directed edge and the GF(2) symbol associated 
with it. The undirected counterpart of Fig. |TJd) is as shown 
in Fig. |TJb). (Although G changes after an edge reversal, 
we nevertheless denote the resulting graph by G as well for 
convenience.) 

In obtaining Fig. |TJb), we have effectively swapped y ei and 
y e2 as well as y e3 and y ei , where ei, e% € E(u\) and e^, 6 
E{u2) such that the Hamming weight of the resulting (y)^^) 
is less than what it was originally by 1. Henceforth, we shall 
refer to this process of reducing w((y)E( v )) f° r v £ V" by 
1 through swapping l's and O's in (y)E(u) f° r some u £ V' 
as the weight-reduction of (y)s(„). In general, an overweight 
vertex if e V" with w((y)E(v)) — pA + b may be converted 
to a balanced vertex through b weight-reductions of (y)E(v), 
provided in each instance, the corresponding directed graph 
G is such that if is linked to an underweight vertex via a 
directed path. It therefore remains to show that such a directed 
path exists. 



Recall that an overweight vertex in G implies the existance 
of at least one underweight vertex in the same graph. Corre- 
spondingly, if there is an overweight vertex in G, there is at 
least one vertex underweight in the same graph. Now suppose 
some vertex if 6 V" is overweight. To find a directed path 
linking if to an underweight vertex, we first follow the out- 
edges of if. Each of these edges terminates at some vertex 
Uj € V . We denote this step by V" — > V . Then we return 
to V" following the out-edges of each uj, a step we denote 
by V' — > V". If at least one of these out-edges is incident 
on an underweight vertex, we are done. If not, the above two 
steps are repeated until such a vertex is found. Hereafter, we 
will refer to each pair of consecutive steps, V" — > V' and 
V — > V", as a phase. We proceed to bound from below, 
the number of underweight and balanced vertices found at the 
end of the (i — l)th and ith phase. This will prove the desired 
result. 

First, assume that no underweight vertex is found in step 
V' — > V" at the end of the zth phase. We denote by S*/ and 

(i) 

So , the set of balanced and overweight vertices, respectively, 
found at the end of this phase, and let S® = S a l) U . 
Further, let be the set of vertices in V' found in step 
V" V' in the ith phase. (The out-edges of the vertices in 
are therefore incident on the vertices of S^.) In step 
V 7 *' -» V' of phase i + 1, |5^ } |pA + E„. eS W Pi A directed 
edges are incident on vertices in V', where 
w((y) B (^) 



Pj 



> p>p. 



(3) 



Recall that these directed edges are all associated with symbol 
1 and w((y) E ( u )) = pA, where u 6 V'. Thus, we have 



IT 
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(4) 



The last inequality follows from d3j. In step V' — > V of 
phase i + 1, |T^ +1 ) | (1 - p)A directed ed ges are incident on 
vertices in V" . If an underweight vertex is reached, we are 
done. Otherwise, since these directed edges are all associated 
with symbol 0, we have 
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This lower bound may be achieved when no overweight 
vertices, in addition to those already contained in S , are 



found in step V' — > V^" of phase i 
may be further lower-bounded by 

| T («+i)| + 1 



1. The right-hand-side 
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since 1 — p < 1 — p and pj > p. From |@}, we have 

> |5«| + 2. 

Hence, provided no underweight vertex is found, \S^\ in- 
creases with i. Since is finite, it follows that a directed 
path linking an overweight vertex to an underweight one will 
eventually be found after some finite number of phases, as 
desired. 

That there may be more than one good assignment scheme 
is obvious. ■ 

Now consider a related problem. Let Fx and F 2 be two 
alphabets. For a given choice of p, it is desired that for each 
vertex u E V, exactly pA edges in E(u) be associated with 
F% and the remaining edges in E{u) be associated with F 2 . 
It is further desired that for each vertex v E V" , at most RA 
edges in E{v) be associated with Fx and the remaining edges 
in E(v) be associated with F 2 for some fixed R E (p, 1). 

Trivially, when R = 1, the above two conditions are easily 
satisfied. When R < 1 however, the pA edges of E(u) to 
be associated with Fx have to be appropriately chosen for 
each u E V so that the second of the two conditions above 
may be satisfied for each v E V" . By Theorem Q] this can 
always be achieved. Henceforth, we assume knowledge of a 
good assignment scheme given by a vector y* E GF(2) nA . 
For each vertex u E V , the edges in E(u) to be associated 
with Fi are then given by the support of (y*)E(u)- 

B. The Modified Construction 

For the remainder of this paper, let Fx = GF(q , 1 ) be a proper 
subfield of F 2 = G¥(q 2 ) and a be a rational number satisfying 
< a < 1 and qx = q 2 ■ For convenience, we denote by Fi 
and F 2 , the respective additive groups of GF(qi) and GF(q 2 ) 
as well. 

Let C and C" be (A, rA, 9 A) and (A, RA, SA) MDS codes 
over F 2 , respectively. For some fixed p < r and u E V , 
let $„ be a direct product of groups involving pA copies 
of Fi and (r — p)A copies of F 2 . Next, let £„:<!>„-> C' u 
be a systematic encoding function for the subcode C ' u of C' 
obtained by encoding the subset $ u of information words from 
F 2 rA . The information-bearing code coordinates defined over 
Fx are given by the support of (y*)e(u) where u E V . (Thus, 
the information-bearing coordinates are not necessarily among 
the first or last rA code coordinates.) From [4, Theorem 5], 
the relative minimum distance of C' is also 9. Further, its rate 



iog 92 K\ 



log, 



'12 



p P Ar,(l-p)A 



p(a — 1) + r 
p(a - 1) + 1 



and so is independent of u. Similarly, let C" be the subcode 
of C" of relative minimum distance 5 and rate R^ = (j v (a — 
1) + R)/ (j v (a — 1) + 1) obtained by systematically encoding 
the subset p_i" A p^ R ~i^ A f information words from F 2 RA 
for some j v < R. Moreover, the information-bearing code 
coordinates defined over Fx are given by the support of 
(y*)E(v) where v E V" . 

Now, let x = (x e ) e £E be a word of length \E\ whose 
entries are indexed by E with pAn (resp., (1 — p)An) of 



them being elements of Fx, (resp., F 2 ). Further, let (x)e( v ) 
be the subblock of x indexed by E(y). As in [1], we define the 
code C to be the collection of such mixed-alphabet words such 
that for each codeword c E C, (c) e(u) ( res P-> ( c )e(v)) is a 
codeword of (resp., C'£ ) for every u E V ' (resp., v E V"). 
Next, following [3], let $ = n«ey ^« and ^ : C ^ $ be 

given by V( c ) = ^u 1 (( c )b(«) f) ueV > where c e C ' and 
define the code (C)$ C $ by (C)$ = {^(c) : c E C}. Thus, 
the code C may be viewed as a concatenated code with (C) $ 
as the outer code and n inner codes, i.e., the C' u for u E V, 
each of rate r '. 

Trivially, when p = 0, the alphabet size |<& u | of (C) $ is 
simply cf> = q'x A q 2 r — q 2 A , coinciding with the alphabet 
size of the code (C)$ in [3, Section II]. More generally, 
\&u\ — <j) 1 ~( p ( 1 ~ a ' > / r \ We proceed to obtain a lower bound 
on the rate of (C) 



C. Bounds on the Parameters of (C)$ 

The length N C ' u (resp., N c ») of C' u (resp., C") in q 2 -ary 
symbols is (p(a — 1) + 1)A, (resp., (j v (a — 1) + 1)A). The 
redundancy of C' u (resp., C") in (fc-ary symbols is therefore 
N C ' u (l - r'), (resp., N c »(l - R' v ))- Consequently, if R c 
denotes the rate of C, then its redundancy in q 2 -ary symbols 
is nNc (1 — Rc)- Following [1], since C is additive (so that 
any linear combination of codewords is also a codeword) and 
its redundancy is at most the sum of the redundancies of its 
constituent codes, we have that 

nN eL (l - R c ) < nN CL (l - r') + £ N C ,,{1 - R' v ) 

v£V" 

and after some substitutions and rearrangement, obtain 

, p(a-l) + R 

Rc > f H ; % L 

p(a - 1) + 1 

Recalling the concatenated code structure of C described 
above, it follows that the rate of (C)$ is bounded from below 
by 

R-l 

(5) 



1 1 P(a - 1) + R = 1 



p(a — 1) + r 



p{a — 1) + r 



We next turn to the relative minimum distance of (C)$. 
First, observe that the proofs of [3, Lemma 3.2 & Proposition 
3.3] are independent of the underlying code alphabet. More- 
over, recall that for each u E V and v E V" , the constituent 
codes C' u and C" have the same relative minimum distance as 
their respective "parent" codes, i.e., C and C" . Consequently, 
[3, Theorem 3.1] remains applicable in the current setting, with 
the proof requiring only minor changes, mainly notational. 
From this theorem, we have that the relative minimum distance 
of (C)$ is bounded from below by 



(6) 



1-7(3 



where jq is the ratio of the second largest eigenvalue of the 
adjacency matrix of G to its largest, i.e., A. 
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D. Obtaining Nearly MDS Codes 

Following [3, Example 3.1], let 9 = e for some small e G 
(0, 1] so that r > 1 - e and let q 2 > A > 4/e 3 and G 
be Ramanujan. Following that example, the relative minimum 
distance of (C) $ is at least 



1 - 7G 



Next, let 



> 1-R 



1/2 



R > e 

and for a given choice of a, 

p<e/{l-a) 
By (O, the rate of (C)$ is bounded from below by 



(7) 



(8) 



R-l 



p(a - 1) + 1 - e 



> 
> 



p(a - 1) + R- e 
p(a - 1) + 1 - e 

/7 2 ' by® 
by 0. 



2e 
e , 



Thus, (C)$ approaches the Singleton bound as e — » 0. 
Nevertheless, due to ©, note that the above code design 
yields only codes of moderate to high rate. In particular, if 
p(l — a) = e, then 



|$u| = 4> 

< <t> 

< ^ 

where the bound 1 
small. 



l+( e 3/4)-e 



since 1/A < e 3 /4 
< 1 — e is tight since e is 



Finally, as noted in [4], the codes C' u and C" may be decoded 
using the decoders for their respective "parent" codes. With 
that, it is clear that (C)$ may be decoded using the linear-time 
decoder in [3, Fig. 1]. 

E. Comparisons to the Original Construction 

It should be noted that the rate of the nearly MDS code in 
[3, Example 3.1] resulting from the original construction of 
[3, Section II], is bounded from below by 



1 - 



1 



R 



1 



1 



R-e 
1-e 



> R-e/2 



when R satisfies @. On the other hand, our modifications to 
this construction yields a nearly-MDS code of rate exceeding 
R-e. 

Thus, the reduction in alphabet size from <j) to i^ 1 "^/ 1 ") 
(which recall, is achieved whenp(l— a) = e), is at the expense 
of a reduction in rate. In other words, what we have is not 
an improvement of the results of [3] but rather, a trade-off 
between alphabet size and rate. 

Nevertheless, we have that for R satisfying (0, 



(fl-f)-(fl-e) 
R — § 



< 



2R-e 2(| + e)-e 1 



< e 



and for p(l - a) = e, A = 4/e 3 and q 2 = 0(1/ e 3 ), 

<j} 

as e — + 0. Thus, the trade-off between alphabet size and rate 
is remarkable, for a significant reduction in alphabet size is 
achievable at a price of a very small reduction in rate. 

III. Linear-Time Encodable & Decodable Codes 

We now turn to the linear-time encodable code construction 
method presented in [3, Section V]. In this construction, two 
bipartite regular graphs G\ and G 2 as well as four constituent 
codes are needed, three of which being MDS codes over F 2 
with parameters [Ai,r Ai], [A x , iJiAi] and [A 2 , i? 2 Ai]. The 
forth code is a (n, r m n) code over F 2 2A ' 2 which, as stated 
in [3], could be the code of [5]. We proceed to describe 
a simple modification involving only the graph G\ and the 
[Ai,i?iAi] constituent code which will ultimately lead to 
linear-time encodable and decodable nearly MDS codes over 
smaller alphabets. 

A. The Proposed Modification 

Let the graph G\ = (V : V" , Ex) have degree Ai such that 
IV | = |V'| = n as before. Denote the set of edges incident 
on a vertex u in G\ by E\(u). As in Section Hl-AI assume 
an ordering on the vertex set V' U V" of G\ which in turn 
induces an ordering on the edges in E\(v) for each vertex 
v S V". Moreover, denote the [Ai, i?iAi, 5iAi] constituent 
code by C\. 

For some fixed p 6 [0, R\], we associate appropriate pAi 
edges in E\(v) with F\ and the remaining edges in E\(v) with 
F 2 for each v £ V" such that exactly pAi edges in E\(u) 
are associated with Fi for each u S V. A good assignment 
scheme, denoted y* e GF(2) raAl , is therefore needed. By 
Theorem [TJ such a scheme can always be found. For each 
v G V", the edges in E\(v) to be associated with F\ are then 
given by the support of {y*) El ( v )- 

For each v £ V" , let Cl v be a direct product of groups 
involving pAi copies of F\ and (R\ — p)Ai copies of F 2 . 
In addition, let e\ v : fl v — > Ci tV be a systematic encoding 
function for the subcode C\. v of C\ obtained by encoding the 
subset f2„ of information words in F 2 RlAl . The information- 
bearing code coordinates of C\. v defined over F\ are given by 
the support of (y*)E 1 (v)- From [4, Theorem 5], the relative 
minimum distance of C\. v is also 5% for each v G V". 

Observe that if c is an nAi-tuple with pAi elements defined 
over Fi and (1 — p)A\ elements defined over F 2 such that 
( c )ei(v) G C\ for each v G V", then for each u G V, exactly 
pA\ (resp. (1 — p)A{) elements of the Ai-tuple (c)e 1 { u ) are 
over F\ (resp. F 2 ). With that, the construction in [3, Section 
V] may be modified to obtain a linear-time encodable code C 
of smaller alphabet size by replacing the encoding function e\ 
in Step El of [3, Fig. 2] by the E\ >v , while keeping Steps E2 to 
E4 unchanged. More specifically, given an information word 
from Iluey" ^v, the resulting encoder outputs the codeword 
x = (x u ) ue yi where each x„ is an element of an alphabet of 
size 

r _ pAi (l-p)Ai+A 2 
1 — Hi H2 
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B. Obtaining Nearly MDS Codes 

Following [3, Section V-C], let (l-r )Ai = r m R 2 A 2 and 
R = Ri = R 2 . Further, let k be a universal constant such that 
r m > k and 1 — tq < ne. For this choice of values, 

i — q 2 

where s = p(l — a). On the other hand, the corresponding 
code constructed in [3, Section V-C] has alphabet size 

A 1+ A, (l + ^3)Ai 
7 = 9 2 = <?2 



Now 



l-i-o 
r m R 



1 + 1 ~ r P 
^ r m R 



1 



l-'-o 
r m R 



< 1 



R 



R + e 



1 1 & 

since ^r—^; < j^- Thus, Y < 7 and so a larger value of 

s is clearly desirable. We will show that when R = 1 — 0(e) 
or i? = 0(e), C is nearly MDS with alphabet size less than 
^i-o(e) an( j rate g rea t el - than R — e . 

We begin with the rate rc of C which may be expressed as 



(R - s)A 1 n 



(R-s)A 1 



log 92 r» (1 - s)Am + A 2 n (1 - s)Ai + A 2 
Since A 2 = < -|Ai, it follows that 



R 



(9) 



We wish to have 



1-s 

.2 



> ii — e, or equivalently 



sir - s(l + e)i? + e 2 > 



from which, we obtain the bound 

e 2 

s < 



i?(l 



(10) 



(11) 



If the discriminant s 2 (l + e) 2 — 4,se 2 of the left-hand-side of 
([Tol l is less than zero, then 



< s < 



Ac 2 



(1 + e) 2 



otherwise 



4e 2 



(1 



< s < 



R(l + e-R) 



(12) 



where the last inequality follows from ( fTTT > and the fact that 
Since a larger value of s is desirable, we 



4c J 



< 



(1+e) 2 - R(l+e-R) ' 

focus on the latter case for which, rc > R — e when 



i? > 



4c 2 



(13) 



or 



R < 



l + e-J(l + e) 



-ic 2 



Therefore, for R G (0, 1], we have that 

R 



{R + e)(l + e-R) 



< 1- 



R + e 



-s < 1- 



4i?e 2 



(i? + e)(l + e) 2 



In particular, when R = 1 — 0(e) or R = 0(e), we have that 

r< 7 1 -°( e ). 

Finally, we consider the minimum distance of C. Since 
C\ can be decoded by the decoder of its "parent" code, the 
decoding algorithm in [3, Fig. 4] can be applied to C. Provided 
both G\ and G 2 are Ramanujan, any received word with t 
errors and p erasures such that 2t + p < (1 — R — e)n can be 
uniquely decoded to the transmitted codeword. This implies 
that the relative minimum distance of C is at least 1 — R — e 
and so C is nearly MDS. 

C. Comparisons to the Original Construction 

As with the linear-time decodable code construction, the 
reduction in alphabet size from 7 to Y is at the expense of a 
reduction in rate, as the rate of C and its counterpart in [3, 
Section V] is lower bounded by . R ~*c (from (0) and ,^ r _ , 
respectively, and 

R R-s s{\ - R) + f 



1 + 



1 



> 0. 



Nevertheless, as in Section Hl-EI we will show that the reduc- 
tion in rate our modification brings, is marginal compared to 
the improvement in alphabet size in the high rate case at least, 
i.e., when R satisfies (1131 . 

First, since sR > 0, we have that 

R R — s _ _ „, 

ft ~ 1_J7 ^ 
R' 



i+i 



R 
1+4, 



R + e- sR 



R 



When R satisfies (Q2h it follows from ( fl2b that s and in turn 
tend to zero as e — > 0. On the other hand, setting Ai = 
a_fj/e 3 as in [3, Section V-C], we have that 



sAi > 



4c 2 



CtR 



4a j 



(1 



and so when q 2 = 0(l/e 3 ) 

7 -r 



1 



7 



q 2 sAl > 1 



e(l 



1 



as e — > 0. Finally, since (7 — ^/7 < 1, it follows that (7 — 
r)/7 — > lase^O and so once again, we see that a significant 
reduction in alphabet size is attainable at a price of a very small 
reduction in rate. 
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